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ABSTRACT 


The design of controllers to provide quasi-minimum 
time-response is investigated. With the control law to be 
realized as a piecewise-linear combination of the instan- 
taneous state values, the problem is to select the para- 
meters which define the best suboptimal switching surface. 

A worst-case response-time performance index is de- 
fined and shown to be suitable for use in the suboptimal 
controller design. A proposed design technique is describ- 
ed and used to determine controllers for second-order sys- 
tems. The results of the illustrative examples are compar- 
ed with controllers designed using a least squares polyno- 
mial fitting technique. The comparison shows that the 
proposed method designs significantly better controllers 


in terms of deviation from optimal response time. 
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1. INTRODUCTION 
This thesis presents a proposed method for the design 
of controllers that provide gquasi-minimum-time response of 


systems described by the set of state equations 
@.T) x(t) = Ax(t) + Bu(t) 
where 


x +S @neneel state vector 

A is the nxn plant matrix 

u is the bounded scalar control 

B is the nxl distribution matrix of the control. 

In order to insure that an optimal control exists, the 
plant transfer function is restricted to one having only 
real, negative eigenvalues, and it is further specified 
that it have no zeros. Additionally, all states must be 
observable and the control effort bounded. 

For plants of the type described, previous studies 
[1,3] have shown that a unigue optimal control will exist 
that transfers the plant from any point in the state space 
to the origin with no more than n-l switches of the control. 
Furthermore, the control will always be at its maximum pos- 
itive or negative value (i.e. the bang-bang control). 
Since the control is always at its maximum value, an ideal 
relay can be used to provide the control to the plant if 
some other device can be constructed to properly control 


the relay as shown in figure l. 


Plant Controller 
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Figure l. Optimal Controller 


From the figure it is seen that 

(1.2) u = sgn 0 
Therefore, the controller must generate the proper o to 
transfer the plant from x(0), the iWigekal con@istsen Vegq 
tor,,to x(f), the desired final condition vector, in mini- 
mum time. When the plant input, r, 1s zero the problem 
begemessthateof she lanoam gegulatex since»the desired 
state of the system at the final time is the state space 
origin. If r is non-zero but restricted to an allowable 
class ,o@f input functions, the effect may be deseribed as 
a shift in the state origin. 

Time-optimal control can be implemented for the sys- 
tems considered in this study by one of two general meth- 
ods. In the first method, a digital computer is used as 
the controller. The computer must rapidly calculate the 
control using the differential equations of the plant and 


the specific initial condition. The disadvantages of this 


method are that it is open-loop which is undesirable since 
unexpected disturbances are not taken into account, and it 
is possible that the computer may not be able to generate 
the solution rapidly enough to allow proper switching of 
the control. The second method of generating the optimal 
control is to determine oO as a function of the state vari- 
ables of the plant with some electronic device. While 
more appealing than the first method, this method is lim- 
ited in application by the fact that a closed form ex- 
pression for the switching function is not usually obtain- 
able for systems of higher than second order. 

In many instances the complexity and cost of the op- 
timal controllers described above is not justified from an 
engineering point of view. That is, a less complex and 
more easily implemented controller may be acceptable if it 
can be designed to deviate from optimal performance by 
only a "small" amount. The problem then becomes that of 
developing a design procedure which results in an easily 
realized controller that produces acceptable, suboptimal 
response of the plant. 

In this investigation a suboptimal design method is 
developed using a controller of a pre-specified form. The 
parameters of the controller are adjusted to provide ac- 
ceptable time response of the plant. In the state space 
the optimal switching function, a consists of a hyper- 
surface that divides the space into regions of +M and -M 


control, where | mM | is the absolute magnitude of the bound- 


ed control. Throughout the remainder of this study it 
will be assumed that all equations are normalized so that 
Im | = 1. It would seem that the switching function gen- 
erated by the suboptimal controller should be a hypersur- 
face that lies “close" to that generated by the optimal 
ComeroWler . 

The suboptimal switching function used in this work is 
a piecewise-linear combination of the state variables of 
the system. 

In Section 2 the optimal and suboptimal switching sur- 
faces are described. Selection of an index of performance 
is the topic in Section 3. An outline of a proposed design 
procedure for suboptimal controllers is presented in Sec- 
tion 4 and Section 5 gives the results of suboptimal con- 
troller designs using the proposed procedure and compares 


the designs with controllers designed by another method. 


ko. 


x 


2. THE PIECEWISE-LINEAR SWITCHING FUNCTION 
2.1 The Optimal Switching Surface 

For time-optimal control the switching function di- 
vides the state space into areas of 7) control. The 
closed form of the optimal switching function as a func- 


tion of the system state variables can be expressed as 


(2.1) o” = £" (x) = 0 


Alternatively, this function can be expressed as 


(2.2) o = £ (x') - > o 


where 

* indicates optimal 

x' is the previous x vector with the x, component 

removed 
if the function is single valued in x. . The function 
£ (x') is independent of x and gives the x coordinate of 
the optimal switching surface. For plants of the form pre- 
scribed for this study, Smith [2] has shown that the sur- 
face can be made single valued in the uncoupled state vari- 
ables by transforming to Jordan canonical form. In many 
instances, however, the optimal switching surface is al- 
ready single valued in at least one state variable so that 
no transformation is necessary. 

Since n-l switches of the control are required to 
transfer the system from any initial point to the state 
Space origin in minimum time, the optimal switching sur- 


face may be generated by integrating the state equations 
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backwards in time and switching the control n-2 times. 
This procedure generates one half of the optimal surface. 
The other halts wcasily obtainedysinee sthessmetage is an 
odd function of the state variables for a linear system 
with symmetrical control. 

The optimal switching surface and trajectories for a 
second order, double integrator plant may be obtained by 


solving the differential equations of the plant, 


x (t) es Xo (t) 


(2a) 


| 
G 


X(t) 


where 


Using classical methods to solve these equations with a 


given set of initial conditions x(t) yields 





for u = -l 
- i 
x4 (t,) = x, (t,) + tx, (t.) - 5 t 
(2.4a) 


| 
ct 


For u= +#)o.4 4 LJ! 


I. 


No[e 
ct 


A eIReS EE ALLE). Re 
(2.4b) 


The minimum-time trajectories in the state space may be 


obtained by eliminating the variable t and solving for 


5 


x, (t) in terms of x5 (t) which results in the well known 


families of parabolas 


i 
| 
feed 


hole 


x, (t) x. (t) + Ci for u 


(2.5) 


Lt = 
x, (t) 5 x. (t) + C, foe ue= +1 


The families are shown in figure 2. 


a x 


( \ 
\ : / 


(b) u = #1 Cay ue= wii 


Figure 2. Minimum-Time Trajectories 
To force the states of the system from a set of random ini- 
tial conditions in the state space to the origin in mini- 
mum time, the families shown above must, generally, be 
combined to produce the minimum-time trajectories as shown 
by Pontryagin [1]. Four typical trajectories are shown in 


figure 3. 
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Figure 3. Composite Minimum-Time Trajectories 


From point (a) the minimum-time control sequence is u = -l 
followed by a switching to u = +1 when the trajectory in- 
tersects the u = +l parabola that passes through the ori- 
gin. For point (b) the opposite sequence must be follow- 
ed. Since points (c) and (d) are on the parabolas that 
pass through the origin, no switches of control are re- 
quired. (c) and (d) can reach the origin with n-2 switches 
of control, therefore they lie on the optimal switching 


surface, in this case a line, which from equation(2.4) is 


(226) X, = - = x | x 


2a Die Eaiecewiseshinear Switching Surface 

Since the suboptimal switching function specified in 
this study is a piecewise-linear function of the state var- 
lables of the system it can be expressed as 


(257) G MF(x') - x, = 0 


14 


where 

A indicates suboptimal 
For the second-order systems considered in this investiga- 
tion the switching surface reduces to a line in the state 


Space and is given by 
(2.8) er Teyye(2y xy Iie ye l=Pi@) Ae(2yx, #P(1) 1 


L 
Tx, -P(2) + ){a(a)x, Lx, -P (24-2) ] 


1=2 


+[-A(i)x, +P (2i-1) ] fx, -p(24) J} 


% 
where 


Poem ed 21-1) -P.@2i-3) J /le (21) -P(2i=2))) 


{\(axrg) i (ecg) 20 


O otherwise 


L = number of PWL segments 


P(odd) = Xo coordinates of breakpoints in the PWL sur- 
face 
P(even) = x, coordinates of breakpoints in the PWL 


it 


surface, 


LS 


/ 


Figure 4. The PWL Switching Surface 

For the purposes of this paper it will be assumed 
that the range of initial conditions is known. P(2L) will 
be determined by this expected range. The design proce- 
dure must determine the best, in some sense, values for 
the other 2L-1l1 parameters of the surface. The number of 
segments, L, in the pwl surface is not prespecified in 
this design procedure since it is desired to complete the 
controller using the minimum number of segments. 

The implementation of the pwl switching surface is 
easily accomplished using resistors, diodes and batteries. 
Redderson [4] has shown construction of pwl function gen- 
erators using these elements. The objective of this inves- 
tigation is the development of a method for selecting the 
best parameters describing the pwl surface. The remainder 


of this study will deal with the design method develop- 
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emt --siol wee pivsies)| cCometructson of the control ier. 
2.3 Effects, of PW Switching 

As described previously, @ maximum of n-1l switches of 
control are necessary for minimum-time control. Since this 
study deals with suboptimal control, it is of interest to 
investigate the trajectories and switchings caused by the 
suboptimal switching surface. Consider the one segment 


pwl switching surface shown in figure 5. 





Figure 5. Effects of PWL Switching 


For the case of one segment, the pwl switching pro- 
blem reduces to the linear switching problem using tachom- 
eter feedback for a relay controller as described by 
Gibson [5] and others. In figure 5 the trajyectomy ‘Ghtett 
intersects the pwl surface at point (a) will be switched 


optimally and will reach the origin in minimum time. All 


7 


other trajectories shown will deviate from the optimal and 
will, therefore, be suboptimal. The trajectory intersect- 
ing the pwl surface at point (b) will follow au = +1 tra- 
jectory until reaching (c) at which time it will chatter 
or bump down toward the origin. Any trajectory intersect- 
ing between point (d), the point of tangency with an opti- 
mal trajectory, and the origin will immediately begin to 
chatter and will continue to do so until reaching the ori- 
gin. Finally, a trajectory intersecting the pwl surface 
below the optimal surface, such as at point (e), will move 
around the origin until it again intersects the pwl sur- 
face and will then bump to the origin. Due to the nature 
of relay chatter the states of the system can never exact- 
ly reach the origin when bumping occurs in the final stage 
of a trajectory. A system will be considered to have 
reached the origin when the states enter and remain within 
a Circular neighborhood or radius r. 

For a multiple-segment pwl surface the effects noted 
above all occur, but the problem is compounded since they 
may occur on each segment. A two-segment pwl switching 


surface is shown in figure 6. 
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Figure 6. Multiple-Segment PWL Switching 


From point (a) a trajectory will move around the origin 
until intersecting the pwl surface at (d) and then bump to 
the origin. From point (f) a trajectory will follow a 

u = +l parabola to (g), bump to (c), move around the ori- 
gin to (e) and then bump down. The trajectory intersect- 
ing at (b) will bump to (c) and then follow the sequence 
described above to the origin. 


Redderson [4] gives the time it takes a second-order 


system to bump from x, (t,) ce x, (t,) along a pwl segment 


as 
atbx, (t,) 
(2.9) 5 Log aspx (e | 
fe) 
where 
b = slope of the pwl segment 
a= 


Xo intercept of the segment. 


To achieve good suboptimal performance this bump time must 


be minimized since it represents the major deviation from 


LO 


optimal performance. Bumping must also be minimized be- 
cause frequently repeated rapid changes of control are not 
desirable in physical systems due to the component wear 


Die@auced . 
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3. SELECTION OF AN INDEX OF PERFORMANCE 

3.1 General Comments 

In order to evaluate any design method for the pro- 
posed suboptimal controller, an index of performance, or 
cost index, must be specified. The index should indicate 
how much the suboptimal controller causes the system to 
deviate from optimal performance. Since quasi-optimal con- 
trol is desired, the optimal and suboptimal responses 
should deviate by only a small amount. The cost index se- 
lected should indicate close to optimal performance by 
having a small value which should increase as optimal and 
‘ 


suboptimal control deviate to a greater extent. For time- 


optimal control the cost index is defined as 
iis 
(‘Sacaill)  — 


Minimizing the above index leads to the time-optimal switch- 
ing surface discussed in section 2.1. 

The selected cost index should generate a smooth cost 
surface to allow easy location of the minimum. Three dif- 
ferent types of cost indices may be defined for use in the 
suboptimal problem as described in this paper. The three 
types ake 

a) response-time summation indices 

b) non-response-time indices 

c) worst-case indices 


These three types of indices will be discussed in the re- 


Pe 


mainder of this section. 
3.2 Response-Time Summation Indices 

Since the problem being studied is that of quasi-min= 
imum-time control, a cost index that evaluates the design 
on the basis of the actual plant response times under pwl 
switching seems desirable. Many indices of this type may 


be defined. Some examples are given below. 


K 
; 1) ged ye 
(Bie2 ) i) =) : 
jm] 
K 
=" ) * 
2) Jo =x t/t, 
i=l 
K 
-~i Ve 
3) J =e / ry ty 
i#1 
K 
4 a & y a ae ce) 
4) Jy me) (t ts ) 
i=] 
K ‘ ay 
| ee oe 
at aot: die: 
6) J e ly We ei A 
J 6 == x a 
Ta] a. 


Where K = number of initial conditions 


Pr th 


4 t , ‘ =, 4 
t.= pwl résponse time Lot {I initial 


condi tion 


— = optimal response time for jth 
initial conditign 

The indices defined above are summations of various 
measures of system response time and include effects from 
all initial conditions in the evaluation. A desirable 
feature for an index would be that it equally weight all 
initial conditions regardless of their location in the 
state space. Of the indices given above Jy and J give 
more weight to initial conditions further from the origin. 
The other indices give equal weight to all initial condi- 
tions since a normalizing factor, i/t, is used. It then 
appears that this normalizing factor should be used in 
the index finally selected for this study. 

The indices defined above all possess a major limita- 


tion which appears only after a detailed study of the cost 


surfaces that they generate. 


“9 
P(2 = 
} } } 
ar Pm 7 
b _* a a 
aa = 
é — 
d 
| 


P(1) ———— 


Figure 7. One-Segment PWL Switching 
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Figure 7 suggests that if the parameter values are adjusted 
so that the trajectory for a particular initial Ge@n@ition 
such as (c) is switched at the optimal surface, it will be 
truly optimal and the summation indices will generate a 
local minimum in the cost surface at this parameter set- 
ting. As the parameter P(1) is varied the other initial 
conditions will coriee optimal trajectories for certain 
settings as described above and will cause additional lo- 
cal minima. The number of local minima in the cost sur- 
face increases with an increase in the number of initial 
conditions, however, the depth of each is less since each 
component in the summation has a smaller effect upon the 
total. 

Figure 8 shows the cost surfaces generated wy unre Six 
summation indices for four initial conditions as P(1) is 
varied from -4 to -8. The figure shows that four initial 
conditions may produce more than four local minima. The 
effect upon the cost surface of increasing the number of 


initial conditions is shown in figure 9 for J, as K is in- 


5 
creased from foursto ten. It is seen that the surface is 
smoothed considerably by the increase but that the number 
of local minima is also increased. The irregularity of 

the cost surface is the problem that limits the wse of the 
summation indices. Normal search techniques are not able 
to lo¢ate the global minimum but will stop when a local 


minimum is reached. With the possibility of the search 


terminating upon reaching a local minimum the parameters 
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of the pwl surface’ selected may not be the best attainable 
and the designer will not be sure when the best design has 
been completed. Frederick [6] has improved the shape of 
the cost surface generated by a summation index by limit- 
ing the number of pwl surface parameters to a number which 
allows it to be easily searched... Limitation of the number 
of, pwl, parameters. in this fashion is felt to reduce the 
ability of, any, design, procedune to axyrive at the best sub- 


optimal controller. 


3..3 Non-response-Time Indices 
In view of the irregular shape and attendant search- 
ing difficulties of the cost surfaces generated by the 
summation indices discussed above, another measure of sys- 
tem performance must be defined if a controller design 
method is to be developed. Smith [2] has used the well- 
known least squares curve fitting, technique to fit the pwl 
surface to the optimal surface for a specified set of break- 


points in the pwl surface. The index for this method may 


be defined as 


Pp 
(2.3) a = 053 i A 
J=] 
where 
% = points describing the optimal surface in the 
independent variable, x. 
Ks = points on the pwl surface in the independent 


* 
variable corresponding to xy 
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P = number of points over which the pwl surface is 
fitted. 

The object of Smith's design method is to minimize this in- 
dex which represents the sum of the squared distances be- 
tween points on pwl and optimal surfaces measured in the 
coordinate direction of the independent state variable. 
Using the analytic least squares technique the desired 
minimization is easily accomplished. For one pwl segment 
with one variable parameter this index generates a smooth 
parabolic cost surface which is easily searched. 

While simple in concept and implementation, the above 
method suffers from the fact that it does not guarantee 
good time response of the plant. It only assures that 
the pwl surface will lie close to the optimal surface. 
Actual system response time is never considered in the de- 
sign of the switching surface. After the design is com- 
pleted it may be partially justified by using the control- 
ler with the plant for a set of representative initial con- 
ditions and observing the performance. This is an after 
the fact type of evaluation and the design must be complete- 
ly redone if the performance is not acceptable. Also, as 
stated above, the breakpoints of Smith's pwl surface, the 
P(even) in the notation of this paper, are specified prior 
to the least squares minimization. This allows optimiza- 
tion of only one half of the available pwl parameters. It 
should be observed that if the design is found to be un- 


acceptable it can be repeated with another set of break- 


ao 


points. The problem with this procedure is that previous 
trials provide little information of value in selecting 
the breakpoints for future trials. 

Redderson [4] also used least squares fitting tech- 


niques but defined his cost index as 


fh | - 
(3.4) aims ) (6,7) 


where 6 is defined as the transverse trajectory time be- 
tween the pwl and optimal surfaces as shown in figure 10. 


x 





Figure 10. Transverse Trajectory Time 


Minimizing this index relates the pwl fitting to system 
response time, but it is not really a measure of overall 
performance. Since it measures trajectory time between 

the surfaces it again, as does Smith's index, only assures 
that they will be close together. Actual system perform- 
ance must be evaluated upon completion of the design using 
representative initial conditions. The advantage of this 
method over Smith's is that the breakpoints of the pwl sur- 


face, as well as the slopes, are allowed to vary which re- 
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sults in optimizing over all of the parameters. MThis 
should result in a better least squares fit and, if indeed 
there is a relationship between the goodness of fit and 
response time, better system performance. Since there is 
no definite relationship between these quantities addi- 
tional response -time indices should be considered in an 


effort to provide better suboptimal response. 


3.4 Worst-Case Response-Time Indices 


The difficulties of local minima with the summation 
indices and of no real relationship between good least 
squares fit and good system response can be avoided by 
selecting an index that measures the worst deviation from 

’ 


optimal performance for the set of initial conditions. 


Three examples of this type of index are given below. 


x 
BAS. J... = mex t./t. 
1 yk 
x (0) 
* 
(3.6) Jo = max (t, - t; ) 
x (0) 
A * * 
(2495) J, = at (ee ts )/t, 
where 
_ i. eg. ae 
t; = pwl response time for 1 initial condi tien 
* , AC oi caret wi 
t; = optimal response time for 1 initial condition 
x(O) = initial condition vector. 


The cost surface 1s generated by minimizing the indices 
with respect to the pwl parameters. The design can then be 


described as the min-max problem which has been studied by 


3a 


von Neumann oe and others. 


* 
(Sas) J = Min gman 
P x (0) 


where 

P is the™vector"of pwl parameters. 

As noted by Kalman [8] the minimum-time problem can be re- 
garded as a two-player zero-sum min-max game. That is, 
nature tries to maximize response time while man tries to 
minimize it. 

Since it is desired that the index selected indicate 
desired performance and generate a smooth cost surface, 
the three indices were, evaluated for the second-order;one 
pwl segment case. Figure 11 shows the surfaces as P(1) 


Var tec wom edSetes—-50.7 with P(2)oset. at One Otuaaied 


iu 
J. show smooth behavior over the range of the variable 
parameter. Jo is also generally smooth but does show 

minor irregularities. The points plotted are the costs 


for a set of 24 initial conditions spaced along the x, co- 


i 
ordinate axis. 

If the min-max point, a as given "by equation (3.8), 
can be found the designer is assured that system perform- 
ance for all the initial conditions can be no worse than 
Cirett igenencea' by ie The system performance for other 
initial conditions within the design range will be dis- 
cussed in sections 4 and 5. Figure 11 shows that all 


three indices generate easily searched cost surfaces. For 


the design method to be presented in the next section the 
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index 


7) = ae aan th 


was chosen. This = measures the worst deviation be- 
tween pwl and optimal performance. It also includes the 
Hemme Zing factor 1/t™ to insure that all initial condi- 
tions are equally weighted while looking for the one with 
maximum deviation. As an example of the necessity for 
this weighting, consider a deviation time of 2 seconds. 
If the optimal response time were 15 seconds this devia- 
tion would probably be acceptable. 


— 2a 
JT = Te = -1333 


However, with an optimal response time of one second, the 


normalization clearly shows that this performance is poor. 
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4. DESIGN OF THE PWL SWITCHING SURFACE 
4.1 Steps of the Design Procedure 
In order to obtain acceptable performance from the pwl 
controller it is necessary to determine the parameters that 
minimize the cost index selected in the last section. The 
steps of the procedure to obtain these parameter values 
are listed below. 

a. Select the region in the state space for which 
the design is desired and a set of initial condi- 
tions representative of this region. 

b. Obtain the optimal response times for the select- 
ed initial conditions. 

c. Select an initial set of parameters to define a 
one segment pwl switching surface. 

d. Evaluate the cost index to determine if perform- 
ance of the controller is acceptable. If it is 
acceptable the design is complete. 

e. If performance is not acceptable, vary the para- 
meters in some systematic manner to improve per- 
formance. 

f. Repeat steps (d) and (e) until performance is 
acceptable or no further improvement is possible. 

g.- When no further improvement is possible and per- 
formance is still unacceptable, increase the num- 
ber of pwl segments by one by defining a new set 
of initial parameters. 


h. Repeat steps (d) through (g) until acceptable per- 


3D 


formance results or no further improvement is 
possible. 

Thus far, it has been stated that the design process 
1s completed when a set of pwl parameters is found that 
produce "acceptable" performance of the plant. At this 
point it is necessary to define this acceptability crite- 
rion. The procedure outlined above, when used with the 
cost index selected in the last section, results in mini- 
mizing the normalized or percentage deviation time for the 
set of initial conditions. By defining the acceptability 
criterion as some percentage deviation from optimal re- 


sponse time, 





| & 
(a) J_ = = At. = (t-t ) acceptable 


the procedure assures that the system will respond at least 
this well, and for most initial conditions it will be bet- 
ter. It also completes the design using the minimum number 
of pwl segments and upon completion of each cycle indicates 
the improvement gained by the addition of the last segment. 
The value selected for J. is a function of many var- 
1ables. The system being controlled, its employment, allow- 
able cost and complexity of the controller are all factors 
that must enter into selection of the acceptability crite- 
rion. The designer must determine how close to the optim- 
al he desires the pwl controller to operate in view of the 
above factors. After the pwl parameters are selected by 


the design procedure, the controller must be implemented 
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using pwl function generators to produce the control as a 
combination of the state variables as described in section 
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4.2 Selection of the Initial Conditions and Their Range 


While it would be desirable for the pwl controller to 
provide acceptable control for initial conditions through- 
out the entire state space, the proposed design method min- 
imizes the cost index for the set of selected conditions. 
From an engineering standpoint this is not a serious re- 
striction since for most physical systems a range of ex- 
pected initial conditions can usually be predicted. The 
controller must, then, provide acceptable control over 
this range and not the entire state space. Consider a 
shipboard missile launcher as an example. Under normal 
conditions this system would be at some initial position 
with no velocity or acceleration, Assume that the system 


is modeled as a third order system with the states defined 


as 
x, = angle of launcher with respect to some re- 
ference 
Xo = angular velocity 
X32 = angular acceleration. 


In the three dimensional state space the possible initial 
conditions would be located along the xy coordinate axis. 
The range of the initial conditions is also limited in this 


example by the maximum train angle of the launcher which is 


usually restricted to somewhat less than 27 radians by such 


Oy. 


things as electrical cable twist and structural interfer- 
ence. 

It can be shown that initial conditions lying along 
the pwl surface generally respond more poorly than those 
located in other regions of the state space. In view of 
the engineering considerations mentioned above and the 
fact that placang»the,initial conditions along,£¢he»s pwil,»sur~- 
face requires recomputation of optimal response times after 
each parameter perturbation, it was decided to place them 


along the positive x, axis for the second order examples 


" 
presented in the next section. This corresponds to a sys- 
tem with initial position but no initial velocity. After 
the set of initial conditions is selected for which the con 
troller is to be designed, the optimal response times neces- 
sary for normalization can be generated once and need not 
be. recomputed after each change in parameter settings. 
Selecting the initial conditions in this manner introduces 
an additive constant into the response times, because each 
trajectory moves across the state space in an optimal man- 


ner until it reaches the pwl or optimal switching surface 


at which time it begins to deviate from optimal response. 
x 


Z 
TT 
constant 
u= -l 
deviation 
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=  — 
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Figure 12. Additive Constant in the Response Time. 
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Figure 12 shows the additive constant that results from 

the trajectories crossing the state space before starting 
to deviate. Notice that the normalized deviation time 
index used in this design procedure removes this constant 
Since it measures only the deviation from optimal response. 
If a summation of response times index had been selected 
this constant could affect the optimization process since 
it might reduce the differences between various controllers 
so that the best design was not readily apparent. 

Since the minimization of the cost index is performed 
over a finite set of initial conditions, it is necessary, 
upon completion of the design, to evaluate the system res- 
ponse for other initial conditions in the range of interest. 
This check is required to insure that there are no points 
in the range that result in unacceptable performance. The 
smooth shape of the cost surface should insure that once 
the best parameter settings are found for a large enough 
set of initial conditions, all others in the range will 


respond acceptably also. 


4.3 Selection of the Number of PWL Segments 


In the design of the pwl controller, it is desirable 
to generate the control using the minimum number of pwl 
segments. This produces both the least complex and least 
costly solution to the problem while still providing ac- 
ceptable performance. The design method outlinadin section 
4.1 has this desirable feature. If the performance with L 


segments is acceptable, the design is completed and there 
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is no need to evaluate L+l segments. Smith [2] starts his 
design by specifying the number of pwl segments to be used 
and then attempting to provide good performance by adjust- 
ing the segment slopes. Redderson's [4] method is similar 
in that the number of segments is prespecified, but both 
slopes and lengths of the segments are allowed to vary. 

If an acceptability criterion that allows appreciable 
deviation from optimal performance is selected, linear 
switching may be adequate. Since the proposed design meth- 
od starts with one segment, it will be evident if this is 
true. If a specified number of segments is determined to 
provide unacceptable control, only one more segment is 
added and the design is terminated when acceptability is 
reached. Therefore, use of the minimum number of segments 
is insured. 

Additionally, it is possible to monitor the approach 
to acceptability by comparing the best cost obtained be- 
fore and after adding a segment. If the improvement is 
small, the acceptability criterion should be reviewed to 
determine if it is too strict before adding additional seg- 
ments .which increase cost and complexity. At all stages 
in the design procedure it is well to monitor the effect 
of adding a segment to insure that the design is completed 


using the minimum number of segments. 


4.4 Searching the Cost Surface 


With the cost index, the set of initial conditions 


and the initial pwl segments selected, once the method of 
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searching the cost surface is described the design method 
is complete. For a second-order pwl switching surface of 
L segments the cost surface is a function of 2L-1l varia- 
bles. This 2L-1 dimensional space must be searched to de- 
termine the best parameter settings for the controller. 

In view of the high dimensionality of the cost surface, an 
efficient search technique must be used to minimize the 
computer time required for the design process. 

Hooke aa Jeeves [9] have developed a direct search 
technique and shown that computation time increases roughly 
as the first power of the number of variables not as the 
cube as is the case for most classical minimization tech- 
niques. This direct or pattern search makes use of past 
successful parameter adjustments to predict possible good 
future moves. The search establishes a pattern of impro- 
vement based upon the success of individual parameter per- 
turbations. The size of the pattern grows with continued 
success, thus accelerating the search toward the minimum. 
If a move does not result in improvement, the size of the 
perturbation is reduced until improvement results or a 
limiting criterion is reached and the search is terminated. 
A more detailed description of the pattern search may be 
found in Appendix A. 

The pattern search was chosen for the minimization of 
the cost index in this study because of its relative sim- 
plicity and efficiency. It is noted that this search is 


dependent upon the perturbation step size and the initial 
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parameter settings. More efficient search methods could 
probably be developed to accomplish the minimization but 
it is felt that the pattern search is sufficient for this 
study. The next section will present two examples of this 


method used to design controllers for second order systems. 
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5. DESIGN OF SECOND-ORDER PWL CONTROLLERS 

The real test of any design method for pwl switching 
surfaces is the actual performance of various systems when 
operating with the pwl controller. This section presents 
two examples of controller design for second-order systems. 
Controllers were designed for we and 1/s(sta) plants. 
The systems were digitally modeled using finite state dif- 
ference equations for simulation on an IBM 360/67 high 
speed, general purpose digital computer. The results of 
the designs are presented, and a comparison with control- 
lers designed using Smith's [2] least squares method is 


made. 


9.1 Dewbhe Integrator, 1 oe, Design Example 

The double integrator, l/s’, plant was chosen as the 
first example to test the feasibility of the worst-case 
cost index. The initial conditions were spaced along the 


positive x, axis as described in section 4.2. The optimal 


dL, 


response times for the set of initial conditions wre ob- 


tained using the minimum-time isochrones for the pitenit. 
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+ See Athans and Falb [3], p 714. 
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For the digital simulation of the system the discrete dif- 


ference equations for the plant were used. 


(oO. 2) x,| (KHL) T | x, (KT) + T x. (KT) + + 1 u (KT) 


x5| (K+1) 7 | x5 (KT)+ T u(KT) 


These difference equations were used to reduce the comput- 
er time required to generate the suboptimal response times 
which are necessary when evaluating the success of each ex- 
ploratory and pattern move in the pattern search. Initial- 
ly, fourth-order, double precision Runga-Kutta integration 
was used, but computer time was excessive. Using the dif- 
ference equation method computer time was approximately 
halved. Although the difference equation solution of the 
plant differential equations is less precise than the 
Runga-Kutta integration, no loss of accuracy was observed 
when points describing several trajectories were compared. 
Rather than arbitrarily specifying an acceptability 
criterion, it was decided to allow the procedure to design 
the best possible controller for this first example. The 
fixed parameter and the variable parameter defining a one- 
segment controller were selected and the design procedure 


accomplished. The results of this design are presented in 


figure 13. 








____[aaitiet [Fina 


Figure 13. One-Segment Controller 
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A comparison of the pwl and optimal switching surfaces is 


shown in figure 14. 


aD 


Figure 14. Optimal and Best One-Segment PWL Surfaces 


The final cost listed in table I indicates that the one- 
segment controller causes appreciable deviation from op- 
timal response. 

‘< In order to improve the suboptimal performance, a 
second pwl segment:was added to the controller as called 
for by the design method and the increased set of parame- 


ters optimized. The results are presented in figure 15. 


er aie 
3227 “0907 





Figure 15. MTwo-Segment PWL Controller 
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The two-segment pwl switching surface is shown with: its 


relationship to the optimal surface in figure 16. 





Figure 16. Optimal and Best Two-Segment, PWL 
- Surfaces : | 


The final cost of the two-segment design given in figure 
15.shows that the worst.percentage deviation from, optimal 
response iS approximately nine percent. If an: acceptabil- 
ity criterion of. more than this value: had been: selected 
the pwl controller, design would now be complete. 

| In order to determine if better pwl performance was 
attainable, a third segment was added to the pwl switching 


surface. The parameters were optimized and the results 


are presented in figure 17. 
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Figure 17. Three-Segment PWL Controller. 

The addition of the third segment to the switching surface 
decreased the cost by only .0396 while the two-segment 
case reduced it by .7526 over the one-segment case. 

Unless extremely close to optimal control is desired, the 
complexity added to the system by the third segment may 
not be justified. 

This example has shown that a pwl controller can be 
designed for the 1/s* plant that résults in no more than 
5.11 percent deviation from optimal. response timé for the 
set of selected initial conditions. As mentioned in sec- 
tion 4.2, a check must be made using other sets of initial 
conditions to insure that the design is acceptable over 
the entire range. The two-segqment controller of figure 15 
was evaluated with two additional sets of initial condi- 
tions in the design range. In both cases it was found 
that ’ald anitial conadietons responded acceptably and that 


the parameter settings could not be’ improved. 
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The perturkation step size and initial parameter 
values affect the cost and final parameter values found by 


[9] Tn the 


pattern search as nated by Hooke and Jeeves. 
two segment design, costs were found to vary between .3163 
and .0907 depending upon the step size. However, it was 
found that if the costs for different step sizes were the 
same, the parameter settings of the pwl surface selected 
by the search also agreed. This reinforces the assumption 
that the cost surface is a smooth function of the parame- 
ters, To insure that the best controller design resulta, 
several step sizes and initial parameter settings should 
be tried if the pattern search is used. Computer times 
using the digital model given in Appendix B averaged nine 
minutes for the design of the two-segment controller with 
the IBM 360/67 computer. The three-segment design averaged 
13 minutes, Since computer time is required only during 
the design of the controller, these averages seem a reason- 


able price to pay. 





The last example showed that the proposed design pro- 
cedure can be used to design a pwl controller that provides 
acceptable performance for second order systems. As a se- 
cond example, the 1/s(sta) plant was chosen. This plant is 
better behaved than the 1/s* plant since it has a pole at 
6 = -a that results in a term of the form exp(-at) in the 
time response. This type of response should make the plant 


easler to control than the ifs? plant. 
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Tie stake equations for thig plant are 


x, (t) = X(t) 
(533) 


X(t) “ax, (t) + u a>oO 


The discrete difference equations are found to be 


x, [ (K+1) TJ x, (KT) +(1/a-1/a exp(-aT) )x, (KT) 


(5.4) +(-1/a?+T/at+texp (-aT) /a*) U(KT) 


x, | (Raa | exp (-aT) x, (KT) +(1/at+exp (-aT) /a) U(KT) 


The initial conditions were chosen to lie along the xy 


axis with the limit at x, = 15. For this example a value 
of a = 1 was used. 

The optimal response times and the set of initial con- 
ditions were generated by running the plant backward in 
time, switching the control once, and recording the time 
and x4 coordinate when the trajectory intersected the xy 
axis. A word of caution is in order at this point if op- 
timal response times and initial conditions are to be ge- 
nerated in this manner. For this plant a limit line oc- 
curs in the state space at x, = -~lfa in the fourth qua- 
drant and at x, = l/a in the second quadrant. This means 
that trajectories starting to the right of the optimal 
switching surface and above the limit line will never go 
below al lfa before reaching the origin. Care must be 
taken to insure that switching of the backward time tra- 


yectories does not take place below the limit line if it 


is desired to generate a set of initial conditions along 
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the xy axis. 

After obtaining the optimal response times and ini- 
tial conditions, the design process begins by selecting an 
initial value for the variable parameter of a one-segment 
pwl switching surface. The second parameter is fixed by 
the range of initial conditions. For this example P(2)=16 
was selected. Minimization of the cost index using the 


pattern search was accomplished with the results recorded 


my ra Que eles 
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Figure 18. 1/s(sta) One-Segment PWL Controller 







The optimal switching surface for this plant is very nearly 


linear as shown in figure 19. 


oe, 


pwl 


Limit line 


optimal 


Figure 19. Optimal Switching Surface for 1/s(s+a) 
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The linearity of the optimal surface allows the one-seg- 
ment pwl surface to provide control that is very close to 
the optimal. The maximum percentage deviation from opti- 
mal response time for the set of initial conditions is 
shown in the table to be .645%. As in the last example 
two other sets of initial conditions in the design range 
were tested with a pwl controller with the parameter set- 
tings of figure 18 and no worse deviation occurred than 
that found upon completion of the design. 

Since trajectories for initial conditions along the 
xy axis cannot pass below the limit line, they approach 
the switching line as shown in figure 19. Trajectories 


from initial conditions beyond x, = 3.8 reach the switch- 


1 
ing line very close to its intersection with the limit 
line. The design procedure can minimize the cost index 

for any number of segments by passing the first segment 
through this point so that very close to optimal control 
results as it did in the one-segment case. A second pwl 
segment was added to the pwl switching surface to see if 
the above was true or if improvement in the design would 
result. The optimization procedure adjusted the first seg- 
ment so that it did pass through the intersection and a 
cost identical to that obtained for the one-segment design 
resulted. If the first segment were extended the same 
parameter values as listed in table IV would result. After 


the first segment is extended beyond the intersection, the 


trajectories no longer intersect the second segment and no 
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change in the initial parameter settings is made. Since 
no improvement is obtained by adding the second pwl seg- 
ment to the controller the design is completed with one- 
segment. It is to be noted, however, that this probably 
would not be the case for initial conditions located in 
other regions of the state space. The procedure could be 
used to design an acceptable controller for sets of ini- 
tial conditions in other regions of the state space if the 


optimal response times were computed. 


Sees Comparison of Design Methods. 


In this section the two~segment pwl controller des- 
igned in section 5.1 will be compared with controllers 
designed using Smith's [2] least squares, fixed-breakpoint 
method. For the first the xy breakpoints were selected by 
equally dividing the range of interest along the coordi- 
nate axis as specified by Smith. This resulted in one 
breakpoint at x, = O and 9.5. The least squares fit was 
accomplished to determine the slopes of the segments. 
Smith's method with equally spaced breakpoints gives the 


following parameter values when converted to the notation 


of this paper. 


Method Proposed Smith 
P(1) -, 9812 -4.67 
P (2) -4187 2 
P(3) —4 4902 -4.917 
P(4) 10.0 19.0. 


oe 


The pwl switching surface of section 5.1 and that designed 
with the least squares method are shown below. 


2 


\ e 
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Figure 20. Comparison of Switching Surfaces. 


A second controller was designed for comparison using 
the least squares method, but the xy breakpoint used was 
the one selected by the proposed method for the best two- 
segment controller given in figure 15. The parameters re- 


sulting from the fit are given below. 


Method Proposed Smarth 
P(1) -.9812 -.9959 
P(2) .4187 .4187 
P(3) -4.572 -4.1616 
P(4) romeo 10.0 


The controllers were compared on the basis of maximum 
normalized deviation time and the sum of pwl response 
times for a specified set of initial conditions. The re- 


eults@ane llieited in figumes2za 
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Method max (t-t*) /t™ 


Smith equal 

spacing ta/2e Pe. 02 
Smith best 

breakpoint A ele 13m O94 
Optimal pe 66.8165 


Figure 21. Comparison of Controller Designs 












The values in the table show the proposed design proce- 
dure is significantly better than Smith's method when 
evaluated using the cost index of this paper and the sum- 


mation of response times. 


54 


6. SUMMARY 


6.1 Discussion of Results 

The problem of designing an easily-realized, close-to- 
optimal controller was studied. It was specified that the 
control law be realized as a piecewise-linear combination 
of the system state variables. With the controller in this 
form, the problem is to select the parameters that define 
the pwl switching surface which provides the best subopti- 
mal perfommance: 

The viewpoint was taken that deviations from optimal 
performance would be accepted if savings in terms of cost 
and complexity could be achieved. This approach led to 
the concept of acceptable performance of the controller. 
The ‘properties of various cost indices were investigated, 
and the decision was made that a response-time index 
should be selected rather than a heuristic one such as 
the least squares polynomial fit. The problems associated 
with summation of response-time indices were explored, and 
no solution was readily apparent. The worst-case indices 
were then evaluated, and it was determined that if the 
min-max point can be found, a controller can be designed 
that will provide acceptable performance for the region of 
interest in the state space. 

A design procedure that provides acceptable control 
while requiring the minimum number of pwl segments was pro- 


posed. PerlOrmance OL tne mebtnod Tor seCond-older” Syorcems 
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was demonstrated by example and a comparison of perform- 
ance was made with sain ee least squares method. The 
results of the comparison showed that the design method 
of this paper produced a significantly better controller. 
The design method of section 4.1 resulted in controllers 
that allowed only slight deviations from optimal perform- 


ance. Additionally the controllers are simple to imple- 


ment since they use the minimum number of pwl segments. 


6.2 Areas for Further Study 
Although this study has shown the merits of using 


the worst-case cost index, many areas of the suboptimal 
switching problem are open to further study. Perhaps the 
most important addition to this work would be its exten- 
sion to third and higher order systems. As noted previous- 
ly, all system simulations were accomplished using a purely 
digital model. The use of a hybrid model should be invest- 
igated since a considerable saving in computer time requir- 
edmtor thegdesign could be neadiized. The numemous amtegra- 
tions necessary to generate the pwl response times are 
more suitable to analog simulation while the logic capabi- 
lities of digital computation are necessary for parameter 
optimization. | 

The pattern search as used with this design method 
should be investigated to see if it can be modified to re- 
move its dependence upon parameter step size and starting 
point of the search. In the example studies of section 


5.1 and 5.2, it was determined that certain combinations 
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of step size and initial parameter settings caused the 
search to terminate prior to reaching the minimum of the 
cost surface. It is desired that the search reach the 
min-max point under all conditions. Perhaps a new search 
technique especially suited for finding the min-max solu- 
tion regardless of the starting conditions can be developed. 

The feasibility of searching the range of initial con- 
ditions in an effort to locate the true min-max should be 
investigated. It is possible that a point exists in the 
range of initial conditions that results in worse deviation 
than that found for the finite set used. In the examples 
of section 5 other sets of initial conditions in the de- 
Sign range were used to check for possible worse points. 
This check showed no worse points, however, it did not 


prove that none exist. 
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APPENDIX A 
Pattern Search for Cost Index Minimization 

The pattern search technique of Hooke and seer is 
a "direct search" in that sequential trial solutions are 
compared to the previous “best" solution to determine the 
next trial solution. The search minimizes a function of 
several variables, S(p), by determining the sequence of 
values of p that provide improvement in the function value. 

Two types of moves are made in the search. Explorato- 
ry moves are made about a selected base point by changing 
each variable by a selected step size. Each exploratory 
move is successful if S(p) decreases. The exploratory 
moves provide information about the behavior of the func- 
tion being searched. The successful exploratory moves are 
formed into a pattern indicating the direction of a move 
that will probably be successful in reducing the value of 
the function. The sequence of exploratory moves and the 


establishment of a pattern is shown in figure A-l. 


P(1) 





Figure A-l. Exploration and Pattern Establishment. 
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Starting at the Gaxvst bagempoint in the figure, point 
bo p(1) is varied by -A, and S(p) is evaluated. If the 
value of the function is reduced the move is successful 


and point a, would become the new base point for further 


1 


exploration. For the case shown, the -A, move is net ostc- 
cessful so +A, is tried and found to be successful. Point 


a. now becomes the base point for variation of p(2). A 


2 
step of +A, is now made in p(2) and found to be success- 


ful. Point b, is then designated the new base point. 


2 
Rather than repeating the sequence of exploratory moves 

around the new base point, a pattern move is made that re- 

peats the combined moves from the previous base point bo: 

That is, all variables are again changed by the amount 

that was necessary to reach the present base point. In 


figure Ael the pagtern move 2s made frem b, to ci ft the 


t 
move is successful, a new set of explorations is made, a 
new base point is found, and the pattern move is repeated. 


This process tends to accelerate the search as shown in 


figure A-2. 
P (2) 





Figure A-2. Acceleration of Pattern Moves. 


60 


Start 


Evaluate function at 


initial base point 








Dec rease 
STEN a 







Seeart at 
Base Point 


Make 
Exploratory 
Moves 










Is 
function 
value below 
that at Base 
Point 








step 
size small 
enough? 





es 


Yes 


Set new 
base point 
Make patter 
move 


Make Explora- 
tory moves 


Stop 


value below 


Figure A-3. Pattern Search Flow Diagram 
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If the pattern move is unsuccessful, the pattern is 
destroyed and exploration is made about the last base 
point in order to develop a new pattern. It may be ne- 
cessary to reduce the exploration step size in order to 
reestablish a good pattern. After finding a new direc- 
tion to move, the pattern will grow in size as described 
above. : 

When the search has reached the region of the minimum 
of S(p), the step size is decreased in order to continue 
improvement. When the step size has reached prespecified 
minimum size, the search will terminate, and the variables 
have the values for which the function reaches its mini- 
mum. A flow diagram for the pattern search is shown in 


figure A-3. 
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